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Abstract 

In optimal prediction methods one estimates the future behavior of 
underresolved systems by solving reduced systems of equations for ex- 
pectations conditioned by partial data; renormalization group methods 
reduce the number of variables in complex systems through integration 
of unwanted scales. We establish the relation between these methods for 
systems in thermal equilibrium, and use this relation to find renormaliza- 
tion parameter flows and the coefficients in reduced systems by expand- 
ing conditional expectations in series and evaluating the coefficients by 
Monte- Carlo. We illustrate the construction by finding parameter flows 
for simple spin systems and then using the renormalized (=reduced) sys- 
tems to calculate the critical temperature and the magnetization. 
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1 Introduction 



In the optimal prediction (OP) methods presented in earlier work by the author 



problem, or of a problem where the initial data are only partially known, was 
obtained by solving a reduced system of equations for the conditional expec- 
tation of the solution given the partial data. This system, closely related to a 
generalized Langevin equation of the Mori-Zwanzig type P|, |l5| , is derived in 
detail in . Short-time estimates can be obtained by keeping only the first term 
on the right hand side of this system, obtaining a relation between the rate of 
change of a reduced set of variables and conditional expectations of the full rate 
of change; a simplified derivation of this relation is given below. Hald's theo- 
rem H asserts that if one starts with a Hamiltonian system, then the reduced 
system obtained in this way is also Hamiltonian, with a Hamiltonian equal to a 
conditional free energy of the original Hamiltonian system. 

Renormalization group (RNG) transformations [|,|L2|,Jl| reduce the di- 
mensionality of a system of equations by integrating out unwanted scales. That 
there is a qualitative resemblance between OP and RNG methods is quite clear, 
and has been pointed out in particular in the related work of Goldenfeld et 
al. M),|0]. In the present paper we focus on the special case of Hamiltonian 
systems in thermal equilibrium, and show that in this case the RNG transfor- 
mations of the Hamiltonian can be obtained by integrating conditional expec- 
tations of the derivatives of the Hamiltonian; loosely speaking, RNG transfor- 
mations are integrals of OP reductions. This remark, based on Hald's theorem, 
makes possible the efficient evaluation of the coefficients of the new Hamiltonians 
in RNG transformations (the "RNG parameter flow") by simple Monte-Carlo 
methods, for example by Swendsen's small-cell Monte-Carlo RNG The 
coefficients in the new Hamiltonian define the reduced system of equations used 
to estimate the future in OP. To illustrate the construction, we apply it to spin 
systems and obtain explicitly the parameter flows in addition to critical points, 
critical exponents, and order parameters. We exhibit in detail a particular im- 
plementation that is a little awkward if viewed as an instance of a RNG but is 
particularly convenient for OP. 

A little thought shows that what is offered in the present paper is a numerical 
short-cut. Suppose x = (xi,X2, . . .) is a set of n random variables (n may be 
infinite), and let m < n; partition x so that x = (x, x), x = {x\, x%, ■ ■ ■ , x m ), x = 
{x m+ i,x m +2i ■ ■ ■)■ Let p = p(x) be the joint probability density of all the 
variables, and consider the problem of finding a function H = H(x) such that 



and others 



an estimate of the future solution of an underresolved 




(1) 
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where dx, = dx m+ idx m+2 There is no question that H is well defined but the 
obvious ways of finding it can be costly. We are offering effective ways to do so. 
There are other situations where one wants to integrate out unwanted variables 
inside nonlinear functions, and our short-cut may serve there as well; in subse- 
quent papers we shall apply it to problems in irreversible statistical mechanics 
and, cquivalcntly, to problems involving the full long-time OP equations. 



Conditional expectations and optimal predic- 
tion 



) with a joint probability 
dx\dx2 ■ ■ ■ dx n . Consider 

E[uv] = 



Consider a set x of random variables (x\, Xi, . . . , x v 
density of the form Z~ 1 e~ H( - x \ Z = J e~ H ^dx, dx = 
the space L 2 of function u(x), v(x), . . ., with the inner product (u, v) 
J u(x)v(x)Z~ 1 exp(—H)dx, where E[] denotes an expected value. 

Partition the variables into two groups as above, x — (x, x) , x — {x\ , . . . , x m ) , 
m < n. Given a function /(#), its conditional expectation given x is 



E[f(x)\x] = 



f{x)e- H{x Ux 



^x 



(2) 



it is the average of / keeping x fixed. The conditional expectation is a function 
of x, only, and it is the best approximation of / in the mean square sense by a 
function of x: 



E 



(f(x)-E[f(x)\x]Y 



< E 



(f(x) h(x)Y 



(3) 



for any function h = h(x). E[f\x] is the orthogonal projection of / onto the 
subspacc 1/2 of L that contains functions of x only. can be approxi- 

mated by expansion in a basis of L^', keeping only a suitable finite number I of 
basis functions ipi(x), <fi2(x), . . . , <f>t{x), and minimizing the distance between / 
and the span of the ipi(x), one finds 

t 



i=l 



where the Cj satisfy the equation 



<f>c = r, 



(4) 
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where <J> is the matrix with elements $y = (ipi, ipj), c — (ci, . . . , ct), and r = 
((/, tpi), (/, 1P2) •■■,(/, <^))- Usually the inner products can be calculated by 
Metropolis sampling. 

Suppose you want to find a function H — H{x) such that 

e-*W = [ e- H V#dx, (5) 



i.e., write the marginal probability density of the variables x in exponential 
form. Suppose one can write 

t 
i=l 

and and let i < m, where m is the number of components of the vector x — 
Then 



E 



[ ^-H(x)e- H ^dx 
J oxj 

e~ H ^dx (6) 



= £.(-l 0g Je- H ^dx). 

An analogous relation between the derivative of a logarithm of a partially in- 
tegrated density and a conditional expectation arises also in the context of 
expectation-maximization is statistics Q . 

If one can find a basis for L2 consisting of functions of the form -Tj^-tpj(x), 
j = 1, . . . , and provided the set of variables is homogenous so that for all 



i < m the coefficients Cj in the expansions -g^-H\x — Y]^—i c jjf~Pj( x ) are 
independent of i, then the expansion 

H(x) = ^c m (x). (7) 

follows immediately. This is our key observation. 

This construction is just Hald's theorem for OP ||: Suppose one has a 
system of differential equations (written as ordinary differential equations for 
simplicity) of the form 

^<p{t)=R(tp(t)), <p(0)=x (8) 

where if, R and x are n- vectors with components ipi , R , Xi , i = 1, . . . ,n and t 
is the time. Suppose we partition as above ip = (ip,ip), R = (R,R), where ip 
contains the first m components of ip, etc. Suppose the system (8) is Hamilto- 
nian, i.e., m,n are even, R = -g-^ — H for i even, Ri = — H for i odd; 



d 
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H = H(x) is the Hamiltonian and Z~ 1 e~ H is then an invariant probability 
density for the system. 

Suppose we can afford to solve only to < n of the equations in (8) or have 
only to data components x. We want to solve equations for tp: 

^rr = %), £(0) = x, 

where i < to, but the argument of R is the whole vector ip. It is natural to 
approximate Ri(<p) by the closest function of (p for each i < to, i.e., solve 

| = »l# (9) 

The approximation (9) is valid only for a short time, as one can see from the 
full equation for the evolution of in ||,|§, see also below. Hald's theorem 
asserts that the system (9) is Hamiltonian, with Hamiltonian H = H(x) — 
— log J e~ H ( x ^dx, a relation identical to equation (6). The existence of H shows 
that the approximation (9) cannot be valid for long times: the predictive power 
of partial initial data decays at t — > oo for a nonlinear system, and the best 
estimate of (pit) should decay to unconditional mean of ip (which is usually zero). 
The existence of a reduced Hamiltonian shows that this decay can happen only 
to a limited extent and thus the approximation can in general be valid only 
for short times. Equations (9) constitute the short time, or "first-order" , OP 
approximation. 

Suppose however that instead of picking specific values for the initial data x 
one samples them from the invariant density Z~ 1 e~ H ( x > . The distribution of the 
i's is then invariant, and equal to their marginal distribution in the full system 
(8) when the data are sampled from the invariant distribution Z~ 1 e~ H ^ x \ as 
one can also see from the identities exp(— H) = exp (log J e~ H dx) = J e~ H dx. 
The system (9) then generates the marginal probability density of part of the 
variables of a system at equilibrium. Thus OP at equilibrium is a way of reducing 
the number of variables without affecting the statistics of the variables that 
remain. One can make short-time predictions about the future from the reduced 
system with coefficients computed at equilibrium because it is self-consistent 
to assume for short times that unresolved degrees of freedom are in thermal 
equilibrium, as is explained in the OP papers cited above. 

3 Renormalization 

For simplicity, we work here with real-space renormalization applied to variables 
associated with specific sites in a plane, x^ = (xi 1 , x j 2 ,...), where Ik = (ik,jk). 
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ikijk a re integers, all the are inside a square D of side N with N large, and 
the variables are listed in some convenient order. The Hamiltonian H = H^- 1 ' 
is a function of x^\ = H^'(x^'). The need for the superscript (1) will 

appear shortly. We assume that the partition function Z = j e~ Ril ) ( x(1) ) 'dx^ 
is well defined, where dx^ = dxjdxj .... 

Suppose we group the variables xj x , xj 2 , . . . into groups of £ variables (for 
example, we could divide D into squares each containing 4 variables). The 
variables can be referred to as "spins" in conformity with common usage in 

(2) (2) 

physics. Associate with each group a new variable x j , x j 2 , . . . , where J\, J2, . . . 

(2) 

is some ordering of the new variables and Xj^ is a function (not necessar- 

(2) (2) 
ily invertible) of the x\ in the group labeled by Jk, for example Xj fc = 

g(Xj^ +l ,x^ +2 ,...,x^ e ) for the appropriate m. The vector x^ is x^ — 

(Xj^ ,x^ . . .). We can write 

Z = Je- Hm (' W >dxW 

= f dx^ j s (x^ - g ( x W)) e -H (i n^) dx w 

where dx^ = dx j^dx j • • • , and the 8 function is a product of delta functions, 
one per group. If one defines H^{x^) by the equation 

e- ff<2) (* <2) > = J 5 (>> - g(x^)) e- H ^dx^\ (10) 

thenZ = Je- H(2) ^ 2) Ux( 2 l 

The mapping x^ — > x^ 2 \ followed by a change of numbering of the remain- 
ing variables so that J\, J<i . . . (the indices of the new variables x^) enumerate 
the new variables by going through all integer pairs in a reduced domain of side 
is a real-space renormalization group transformation; it produces a new 
set of variables which has less spatial detail than the previous set and such that 
distances between the remaining spins have been scaled down by VJ. If the cal- 
culation is set up so that the mapping x^ — > x^ , H^ 1 ' — > H ^ can be repeated, 
for example, if the range of the variables x^> is invariant and the Hamiltonians 
can be represented in the same finite-dimensional basis, then one can 
produce in this way a sequence of Hamiltonians H^ 2 \ H^ 3 \ . . .; the fixed 
points of the transformation H^ n ' — > H ( n+1 ) for a spin system of infinite spatial 
extent include the critical points of the system, see any discussion of the RNG, 
for example @,|||. 

Consider the special case where xf is one of the x^P in its group-i.e., replace 
a block of spins by one of the spins in the block. More general and widely used 
assignments of block variables will not be needed in the present paper and will 
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be discussed elsewhere. We can identify the spins that remain with x of the 
preceding section and the spins that disappear with x. Equation (10) becomes 
a special case of equation (5), and can be solved for by taking conditional 
expectations of the derivatives of 

Note that the usual RNG representation of a renormalized Hamiltonian by 
means of additional couplings Jl^| is interpreted here as an expansion of a condi- 
tional expectation in a convergent series. The new interpretation may be useful 
both in understanding what is happening on the computer and in deriving error 
estimates. The relation between the RNG and conditional expectations shows 
that the latter can be calculated recursively, as we show in the example below. 

We have written the RNG transformation above in notation suitable for spins 
with a continuous range. The case of discrete (e.g., Ising) spins is automatically 
included, even though it may seem odd to differentiate functions with a discrete 
domain and range. Indeed, add to the Hamiltonian H a term of the form 

where e is small, the sum is over all spins, the product is over a finite number of 
values Xoj, and ip > has a minimum at and is positive elsewhere. For small e 
such a term will constrain the Xi to take on the values xoj , but since at the ori- 
gin the derivative of is zero the calculation of the conditional expectations is 
unaffected by this term and the limit e — > can be taken without actually doing 
anything on the computer. All one has to do is make sure that in the Monte- 
Carlo sampling only the values xoj are sampled. Indeed, results below will be 
given for Ising spins which take on the values +1 and —1, with a "bare" (un- 
renormalized) Hamiltonian — fi^xixj, with summation over locations 

/, J that are neighbors on the lattice; (3 = l/T, where T is the temperature. 

4 A decimation RNG/OP scheme for a spin sys- 
tem 

We consider in detail a RNG/recursive OP scheme where the number of variables 
is halved at each step. The spins are located on a square lattice with nodes 
Ik = {ik,jk), ik,jk integers, and at each step of the recursion those for which 
*fc + jk is odd arc eliminated while those for which ik + jk is even arc kept. 
The spins with ik + jk even constitute x and the others i; the choice of which 
are even and which are odd is a matter of convention only (see Figure 1). The 
variables are labeled by Ik ■ xi ± , xi 2 , . . .. 
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1 ) l c 1 )k 1 



t f t f t 



Figure 1: The decimation pattern 



Given a location I — we group the other variables according to their 

distance from /: group 1 contains only xi, the variable at I. Group 2 (relative 
to I) contains those variables whose distance from J is 1, group 3 contains those 
variables whose distance to / is V2, etc. We form the "collective" variables 

Xk,i = — xj 

group k 

where nk is the number of variables in the group (1 for group 1, 4 for group 2, 
etc.). From these variables one can form a variety of translation-invariant poly- 
nomials in x of various degrees: J2i x i x kj = J2i x i,i x k,i , J2i( x kj) 2 { x k+ij) 2 , 
^jiXkj) 4 , .... In practice the domain over which one sums must be finite, and 
it is natural to impose periodic boundary conditions at its edges to preserve the 
translation invariance. We wrote out explicitly only polynomials of even degrees 
because the Hamiltonians we consider are invariant under the transformation 
x — * —x. The translation-invariant polynomials built up from the Xkj can be 
labeled ifii{x), y>2{x), ■ ■ ■ m some order. 

Expand the n-th renormalized Hamiltonian in a series and keep the first £ 
terms: 

fc=i 

The derivative of this series at the spin xi is 

The functions <p k are easily evaluated, for example: 




= 2Xkj 
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E(^) 4 = 4 E 4 )/nl 

\ J / \ group k J 

etc., where "group fc" refers to distances from /, the variable with respect to 
which we are differentiating (see Figure 2). 

Pick a variable x\ in x (i.e., / = % + j even in our conventions). Some 

of the functions ip' k in (12) will be functions of x only and some will be functions 
of both x and x or of x only. The task at hand is to project the latter on the 
former and then rearrange the series so as to shrink the scale of the physical 
domain. To explain the construction we consider a very special case. 

Suppose one can write 

s w w = c4"V 2 + 4"V 3 + 4"V 4 , (13) 

where <fk(x) — J2 x iXk,i for k = 2, 3,4, . . .. Note that ip' k — -^jfk is a func- 
tion only of x when k = 3, 4 (and when k = 6, as we shall need to know 
shortly) but not when k — 2 or 5 (see Figures 1, 2). We now calculate the 
conditional expectations of the derivatives of given x by projecting them 
on the space of functions of x. First we project ip' 2 on the span of ip' 3 , if' A , ip' & 
(note that ip' 6 is not in the original expansion (13)). Form the matrix $ with 
rows (<p' k , ip' 3 ), {<p' k , (p' 4 ), {<p' k , tp' 6 ) for k = 3,4,6, the primes once again denot- 
ing differentiation with respect to xj. Form the vector r with component 
(((p' 2 , <p' 3 ), (y 2 5 f'i)i f'e))- c = ( c 1j c 2j c 3) b e the solution of $c = r (see 
equation (4)). The coefficients c are the coefficients of the orthogonal projection 
of ip' 2 onto the span of ip' 3 , ip' 4 , ip' 6 which is contained in L 2 . After projection, the 
coefficients of if 3, ip4 in (13) become 

new (n) , (n) 
new (n) . (n) 

«4 =a\ ' +a 2 'c 2l 

and fQ acquires the coefficient a 2 "^C3. 

If one relabels the remaining spins so that they occupy the lattice previously 
occupied by all the spins, group 3 becomes group 2, group 4 becomes group 3, 
and group 6 becomes group 4 (see Figure 2). The new Hamiltonian now 
has the representation 

u(n+l) , , 



with 



(n+l) (n) , (n) 

a 2 ' = a 3 + a 2 c\, 

(n+l) (n) , (n) 

(n+l) (n) 

= a 2 ; c 3 . 
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Figure 2: The collective variables 



More generally, if H w is expressed as a truncated series, partition the terms in 
the series for -J^—H^ into functions of x and functions of both x and i. Add 

OXj 

to the terms which are functions of x additional terms which are functions of x 
and are chosen so that after relabelling they acquire the form of terms already 
in the series (just as above, terms that depend on X^ j, for example, become 
terms that depend on X 2 .j after relabelling). Project the functions of x on the 
span of the expanded set of functions of x, collect terms and relabel. This is a 
renormalization step, and it can be repeated. 

Note that it if one wants to reduce the number of variables by a given factor, 
one can in principle use an analogous RNG/conditional expectation construction 
and get there in one iteration; the recursive construction is easier to do and the 
intermediate Hamiltonians, whose coefficients constitute the parameter flow in 
the renormalization, contain useful information. 

The discussion so far may suggest that one sample the Hamiltonians recur- 
sively, i.e., start with find H^ 2 \ use Monte-Carlo to sample the density 
Z~ 1 e~ Hi ] and find etc. The disadvantages of this approach are: (i) The 
sampling of the densities Z~ 1 e~ Hi ' can be much more expensive for n > 1 
than for n = 1 because each proposed Monte-Carlo move may require that 
the full series for -J^—H^ be summed twice: and (ii) each evaluation of a new 

OXi 1 \ I 

Hamiltonian is only approximate because the series are truncated, and, more 
important, the Monte-Carlo evaluation of the coefficients may have limited ac- 
curacy. These errors accumulate from step to step and may produce false fixed 
points and other artifacts. 

The remedy lies in Swendsen's observation (3) , Jl4| that the successive Hamil- 
tonians can be sampled without being known explicitly. Sample the original 
Hamiltonian, remove the unwanted spins and relabel the remaining spins so as 
to cover the original lattice, as in the relabelling step in the renormalization; 
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the probability density of the remaining spins is Z~ x e~ H ; repeating n times 
yields samples of Z~ 1 e~ H + . The price one pays is that to get an m by m 
sample of Z~ 1 e~ H ' one has to start by sampling a 2 q m by 2 q m array of non- 
renormalized spins, where q is either (n + l)/2 or n/2 depending on the parity 
of n and on programming choices; the trade-off is in general very worthwhile. 
What has been added to Swendsen's calculation is an effective evaluation of the 
coefficients of the expansion of H (") from the samples. 

The programming here requires some care. With the decimation scheme as 
in Figure 1, after one removes the unwanted spins in x^ the remaining spins, 
the variables x^ n+1 ^ , live on a lattice with a mesh size \/2 larger than before; 
after relabelling they find themselves on a lattice with the same mesh size as 
before but arranged at a ir/A angle with respect to the previous lattice. To 
extract a square array from at this set of spins one has to make the size of the 
box that includes all the spins half the size of the previous box. At the next 
renormalization one obtains x^™ +2 ' which can be extracted from by taking 
one spin in four and the resulting box size is the same as the size of the box that 
contains x^ n+1 \ One may worry a little about boundary conditions for x^ n+1 ^: 
the periodicity of x^ is not the same as the periodicity one has to assume for 
x ( n+1 > because of the rotation; the resulting error is too small to be detected in 
our calculations. 

5 Some numerical results 

We now present some numerical results obtained with the RNG/conditional ex- 
pectation scheme. The problem we apply the construction to is Ising spins; more 
interesting applications will be presented elsewhere. The point being made is 
that the construction can be effectively implemented. The results are presented 
for Ising spins. 

In table I we list the coefficients in the expansion of H^> for n = 1, ... 7 
and T = 2.27. The functions <fk are as follows: 

<Pk = J~] xjX ktJ for k = 1,2,3,4, 5,6 
<P6+k=^2(Xk+i,j) 4 , forfc=l,2,3 

Vio = X! X 2J X 3J- 

Note that as a result of the numbering of the yj's the last coefficient is not 
necessarily the smallest coefficient. This table represents the parameter flow 
and if the functions (fit are written in terms of the variables x j the table defines 
the new system of equations for the reduced set of variables. Remember that 
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in the projection on L 2 additional functions are used so that after relabelling 
the series has the same terms , but maybe with different coefficients, as before 
the renormalization. In cn 2 is the sole non-zero coefficient, and its value 

is determined by T and the definition of X 2 ,j, in particular the presence of the 
coefficient n 2 (see above). 

It is instructive to use the parameter flow to identify the critical temperature 
T c . For T < T c the renormalization couples ever more distant spins while 
for T > T c the spins become increasingly decoupled. One can measure the 
increasing or decreasing coupling by considering the quadratic terms in the 
Hamiltonian (the terms of the form J2 x jXk,j) and calculating the "second 
moments" M 2 of their coefficients : 

fc=2 

where dk is the distance from J of the spins in the group k (see the definition of 
Xk,j), is the coefficient of x jXk,.j in the expansion of H^ n \ and I is the 
number of quadratic terms in this expansion. In Figure 3 we show the evolution 
of with n for various values of T (with I = 5 and 7 functions over-all in 

the expansion, including non-quadratic functions). 



— T=1.8 




012345 



Figure 3: Second moments of the coefficients of the renormalized Hamiltonian 
for various values of T for successive iterations 

(n) 

In Figure 4 we show the evolution of near T c = 2.269 . . . with £ = 6 and 
10 terms in the expansion. The non-uniform behavior of M 2 is not a surprise (it 
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is related to the non-uniform convergence of critical exponents already observed 
by Swendsen). Each step in the renormalization used 10 5 Monte-Carlo steps 
per spin. From these graphs one would conclude that T c ~ 2.26, an error of 
.5%. The accuracy depends on the number of terms in the expansion and on the 
choice of terms; with only 6 terms (4 quadratic and 2 quartic), the error in the 
location of T c increases to about 3%. The point is not that this is a good way to 
find T c but that it is a check on the accuracy of the parameter flow. From the 
Table one can see that the system first approaches the neighborhood of a fixed 
point and then diverges from it, as one should expect in a discrete sequence of 
transformations. 

2.6 1 1 1 1 1 



2.4 - 




1 2 3 4 5 



Figure 4: Second moments of the coefficients of the renormalized Hamiltonian 
near T c 
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Table 1 



Parameter flow for the Ising model T = 2.26, 10 basis functions 



iteration 
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a 6 





-.01 


.01 


.01 


.02 


.03 


.02 







-.08 


-.07 


-.10 


-.09 


-.09 


-.08 


a 8 





.04 


.02 


.02 


.01 


.00 


-.10 


ag 





-.00 


-.01 


-.00 


-.00 


.00 


.00 


aio 





-.12 


-.17 


-.18 


-.18 


-.17 


-.16 





2.1 2.15 2.2 2.25 2.3 2.35 2.4 2.45 



Figure 5: Bare and renormalized magnetization near T c 

We now use the renormalized system to calculate the magnetization m = 
E[J2xi /n 2 ]. To get the correct non-zero m for T < T c on a small lattice the 
symmetry must be broken, and we do this by imposing on all the arrays the 
boundary condition Xboundary — 1 rather than the periodic boundary conditions 
used elsewhere in this paper. In Figure 5 we display m computer with the bare 
(unrenormalized) Hamiltonian on 3 lattices: 20 by 20, 40 by 40, 60 by 60, 
as well as the results obtained on a 20 by 20 lattice by sampling the density 
defined by the renormalized Hamiltonian which corresponds in principle 
to an 80 by 80 bare calculation. We also display the exact Onsager values of m. 
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The calculations focus on values of T in the neighborhood of T c where the size 
of the lattice matters; one cannot expect the results to agree perfectly with the 
Onsager results on a finite lattice with periodic boundary conditions for any n; 
all one can expect is to have the values of the small renormalized calculation be 
consistent with results of a larger bare calculation. We observe that they do, up 
to the shift in T c already pointed out and due to the choice of basis functions. 

The determination of the critical exponents for a spin model is independent 
of the determination of the coefficients in the expansion of H {n \ and is men- 
tioned here only because it does provide a sanity check on the constructions, 
in particular on the adequacy of the basis functions. For comparable earlier 
calculations, see in particular Swendsen's chapter in ||. As is well known, if A 
is the matrix of derivatives /da^ at T = T c , those of its eigenvalues 

that are larger than 1 are the critical exponents of the spin system p2| . The 
matrix A can be found from the chain rule (|] , M 



lf k \x 



and the sum is over all the coefficients that enter the expansion. The derivatives 
of the expectations are given by correlations as follows: 



dE[ Vk {x^)]_ = E 



da) 



>) 
3 

dE[<p k (x (n+1) )] 



da ( r +1) 



E 



Mz (n+1) )w(z (B+1) )l - E[<p k (z {n+1) )]E[<Pi{x {n+1) )], 



sec Q . In most of the literature on real-space renormalization for Ising spins the 
variables x^ Tl+1 -' are obtained from x^ n ' by "majority rule", i.e., by assigning to 
the group that defines x^ n+v> the value +1 if most of the members of the group 
arc +1, the value —1 if most of the members of the group are —1, with ties 
resolved at random. For the decimation scheme described above our "pick one" 
rule (a:( n+1 ) is one of the members of the group) is identical to the majority rule. 
There is an apparent difficulty in the decimation because at each recursion the 
number of terms in the summation that defines the basis functions is reduced 
by half while the square root of an integer is not in general an integer, so that 
one has to perform Swendsen sampling on rectangles so designed that the ratio 
of the areas of two successive rectangles is 1/2. This has not turned out to be 
harmful, and the value of the correlation exponent, was found to be 1 (the 
exact value) ±.01 with 10 6 Monte-Carlo moves per spin, the error depending 
mainly on the number of Monte-Carlo moves which has to be very large, in line 
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with previous experience H] . We also checked that in a renormalization scheme 
where a 2 x 2 block of spins is replaced at each iteration by a single spin, the 
"majority rule" and our "pick one" rule for x < ^ n+1 ' > yield similar results. One 
needs fewer terms in the expansion of the Hamiltonian to get accurate values of 
the exponents than to get an accurate parameter flow, but a larger number of 
Monte-Carlo moves. 

6 Conclusions 

We have presented a simple relation between conditional expectations for sys- 
tems at equilibrium on one hand and the RNG on the other, which makes it 
possible to find efficiently the coefficients in a reduced systems of equations for 
a subset of variables whose distribution as given by reduced system equals their 
marginal distribution in the original system. The numerical results above em- 
phasized the neighborhood of the critical point in the simple example because 
this is where the variables are strongly coupled without separation of scales and 
a reduction in system size requires non-trivial tools. The next steps will be the 
application of these ideas to time-dependent problems and to finite-difference 
approximations of underresolved partial differential equations, along the lines 
suggested in JToj ] ; this work will be presented elsewhere. 
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